Recognition of Chaining Gestures in the Flow in the Context of Virtual Theater

Introduction. Our aim is to put on a short play featuring a real actor and a virtual actor, who will communicate through movements and choreography with mutual synchronization. Although the theatrical context is a good ground for multimodal communication between human and virtual actors, this paper mainly deals with the ability to perceive the gestures and chaining of gestures of a real actor. During the performance, our goal is to match real-time observation with recorded examples. Recognition events are sent to a virtual actor which replies with its own movements. We follow an approach similar to that proposed by Campbell [1] or Bobick [2]. In this paper, we will describe these two main aspects of gestures communication: representation and perception.